Quantification of correlations in quantum many-particle systems 
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We introduce a well-defined and unbiased measure of the strength of correlations in quantum 
many-particle systems which is based on the relative von Neumann entropy computed from the 
density operator of correlated and uncorrelated states. The usefulness of this general concept is 
demonstrated by quantifying correlations of interacting electrons in the Hubbard model and in a 
series of transition-metal oxides using dynamical mean-field theory. 
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Correlations in solids arc the origin of many surprising 
phenomena such as Mott-insulating behavior and high- 
temperature superconductivity yj-y] . During the last few 
years the investigation of correlations between ultracold 
atoms in optical lattices has opened another fascinating 
field of research Q . 

In many-body physics correlations are conventionally 
defined as the effects which go beyond factorization ap- 
proximations such as Hartree-Fock theory . The actual 
strength of correlations in a given system is usually quan- 
tified by an interaction strength U relative to an energy 
unit such as the bandwidth W, or by comparing expecta- 
tion values of particular operators, e.g., the interaction or 
the total energy However, there are many other 

quantities which can in principle be used to measure the 
correlation strength. Indeed "correlations" are by def- 
inition a relative concept since they always require the 
comparison with some reference system. Any approach 
which employs the expectation value of a particular set 
of operators for comparison will be biased. This raises a 
fundamental question: Is there an objective way to quan- 
tify the correlations of a system, which even allows one 
to compare the correlation strength of different systems? 

Maximal information about a general quantum state 
is provided by the corresponding density operator ( "sta- 
tistical operator") p ~ ^iPi\'4'i){i'i\, where pi is the 
probability for the quantum state \ipi) to be present in 
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If there exists a basis in which p can 
be completely factorized {p — p^^, where PS refers to 
"product state" ) , the corresponding state is by definition 
uncorrelated [12| . To quantify the correlation strength 
of a quantum state one has to compare p with p^^ in a 
suitable way. 

In this Letter we propose to quantify correlations 
within a statistical approach which is based on the con- 
cept of the von Neumann entropy [ill . U^]. We will 



with respect to an uncorrelated product state provides 
a well-defined, unbiased and useful measure of the cor- 
relation strength in that system. This concept not only 
allows one to quantify correlations, but even to compare 
the correlation strength of different quantum states. In 
quantum theory the von Neumann entropy is defined as 
S{p) = — (Inp)p = — Tr(/51n/5). It quantifies the degree 
to which a quantum system is in a mixed state. In this 
way one can also define a relative entropy [3] 
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show that the relative entropy |14l | of a quantum state 



provided the support [15| of p is contained in the sup- 
port of tj; otherwise AS'(yo||(T) is infinite. By definition 
the relative entropy defined in this way is positive, mono- 
tonic, additive, and convex in its arguments [16j. The 
relative en tropy m easures "how different" two quantum 
states are [IJ, Il6|-ll9| . Therefore we propose to quantify 
correlations by the relative entropy AS{p\\p^^) between 
the statistical operator p of a system and an uncorrelated 
product state with p^^ for the same system [l^liSl- Since 
this approach uses a statistical operator it accounts for 
correlations represented by all possible correlation func- 
tions generated by p. In the following we will make use 
of a reduced statistical operator which restricts the set 
of assessable correlation functions. 

The general approach works as follows (2l| - [25j : Let 
l^*) be any state in the Hilbert space of the system. 
We decompose the system into two subsystems yield- 
ing two Hilbert subspaces A — {\a)} and B = {\b)}, 
where \a) and \b) are basis vectors of these subspaces. 
Then one may write \"^) = X^ah ^o.''!'^)!^) with ampli- 
tudes ^'a,6- We trace out the degrees of freedom of the 
B subsystem. The reduced statistical operator is given 
by pI = TrB\^)m = Ea„aJai)P*,a.(«2|, with the 
matrix elements p* = J2b^ai.,b^*a^,b- By defining di- 
agonal operators, i.e., projectors. Pa = |a)(a|, and off- 
diagonal operators Taia2 = |ai)(a2|, respectively, one can 
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determine = (^-iTa^.a^ l^')^' explicitly. 

In the following we will demonstrate the usefulness of 
this general concept by applying it to interacting lattice 
electrons described by the Hubbard model, i.e., a generic 
many-electron model with purely local interaction. In its 
simplest version it has the form 

H = Y1 ^iAaCja + n^n,^, (2) 

ij i 

where (cia) arc creation (annihilation) operators for 
fermions of spin tr =t (|) at the lattice site i, tij are 
hopping amplitudes between different sites, and U is the 
local interaction energy. The Hubbard model cannot be 
solved exactly. As an approximation we therefore cm- 
ploy dynamical- mean field theory (DMFT), which be- 
comes exact in the limit of infinite spatial dimensions 
{d — > oo) [26j and is known to provide a reliable local, 
but fully dynamical, description of correlated electron 
systems in d = 3 (23, [H • By using DMFT to compute 
the relative von Neumann entropy only the most impor- 
tant, namely local, correlations of the exact solution arc 
taken into account. In DMFT the subspace A is chosen 
to correspond to a site i with the four state vectors |o) = 
{[0), I t), I J'), 1 2)} which characterize the local occupation 
of the site. By computing the statistical operator within 
DMFT we determine the eigenvalues Pa — {^\Pa\'^) of 
the reduced statistical operator pA- We then employ an 
explicit product state |PS) to calculate the uncorrelatcd 
reduced statistical operator and its eigenvalues . 
In this way the relative entropy (j4]) of the two states 
can be determined. In the following, the subspace in- 
dex A = i will be omitted. In the absence of off-diagonal 
long-range order ((^'|c<:r|^') = 0, (*|co-c_o-|*) = OUhe re- 
duced, i.e., local, statistical operator is diagonal [16|, 

/5 = po|0)(0|-|-^^p^|a)((7|+p2l2)(2|. The diagonal 
matrix elements Pa are expressed by the particle number 
density n, magnetization density m, and double occupa- 
tion per site d, i.e., po ^ 1 — n + d, pa- = (n + am)/ 2 — d, 
and P2 = d. Because of its diagonal form the local von 
Neumann entropy is given by S{p) = — ^^Pa logpa with 
a — 0, t, i, 2. Then the local relative entropy becomes 

AS{p\\p''^)=J2pa{\npa-\npl^), (3) 

a 

where p^^ is the corresponding expectation value within 
the factorization approximation corresponding to |PS). 
We note that the reversed relative entropy A5'(p^^||/5) is 
also defined. The statistical operator is no longer diag- 
onal if, for example, the local interaction includes non- 
density type terms, or if superconducting phases arc con- 
sidered. In this case the statistical operator needs to be 
diagonalized to determine its logarithm. 

To compute the parameters n, m, and d the DMFT 
self-consistency equations are solved numerically by us- 
ing the numerical rcnormalization group method at zero 




FIG. 1. Upper panel: local von Neumann entropy of the 
correlated PM ground state as a function of the interaction 
U. Inset: double occupation in the PM (black curve) and the 
AFM (red curve) ground state compared to the Hartree-Fock 
result (green curve) as a function of U. Lower panel: local 
relative entropies (PM phase) between the correlated ground 
state and the noninteracting {U — 0) and local moment {U = 
oo) ground states, respectively, as functions of U. 

temperature [2^. We assume hopping tij = t between 
nearest neighbor sites i, j on a cubic lattice and use the 
corresponding density of states for the DMFT calcula- 
tions. The bandwidth W = Qt = 1 sets the energy unit. 
Wc fix the particle number density at n = 1. In the fol- 
lowing both paramagnetic and antifcrromagnctic ground 
states arc considered. 

(i) Paramagnetic ground state: We analyze the corre- 
lated paramagnetic (PM) ground state |PM) with respect 
to the following two reference states: (i) the product state 
in k space |PS) = |free) corresponding to noninteracting 
{U = 0) electrons, where d = {n^ — m'^)/A, and (ii) the 
product state in position space, i.e., the local moment 
state |PS) = |LM) where d = 0. In the PM phase m = 
implying that S{p) = -2 [din d + (^ - d) ln(i - d)] is 
determined solely by the dependence of the double oc- 
cupation d on U. In the upper panel of Fig. [T]the local 
entropy is shown as a function of U, and d is shown in 
the inset. Both are monotonically decreasing functions 
of U: the local entropy decreases from ln4 at [/ = to 
ln2 at [/ = cx) and the double occupation from 1/4 to 0. 
At half-filling a Mott-Hubbard metal insulator transition 
(MIT) takes place at a critical interaction Uc ~ 1.225, at 
which a correlation gap opens in the one-particle spectral 
function. At the MIT the double occupation, and there- 
fore the local entropy, displays a kink. The free state 
I free) and the local moment state |LM) have constant lo- 
cal entropies S'frco = ln4 and S'lm = ln2, respectively, 
which reflect the degeneracy of those uncorrelated prod- 
uct states. 

The correlated PM state |PM) can be distinguished 
from the product states |frec) and |LM), respectively, by 
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means of four different relative entropies: AS{p\\p ), 
AS{p\\p^^), ASip^'^^Wp), and AS'(pL^llp), which are ob- 
tained from the three statistical operators p, p^™, and 
^LM ^gjjjg Eq ^ 'pijg relative entropies are functions 
of U as is shown in the lower panel of Fig. [TJ The larger 
their value, the more distinguishable the two correspond- 
ing states are. In the Mott phase the relative entropy 
AS{p\\p^'^''^) increases much more slowly with the inter- 
action strength U than in the metallic phase. This means 
that in a Mott insulator the correlation strength increases 
more slowly with U than in a correlated metal. We note 
that AS{p\\p^^) = oo for [/ < oo because in the local 
moment state double occupation is completely excluded 
(pLM ^ |p]y[^ |Ljy[^ perfectly distin- 

guished by measuring the respective double occupation of 
the two states. By contrast, the reverse relative entropy 
AS'(/5'^^| 1/5) remains finite although the two states are 
perfectly distinguishable. This shows that AS{p\\p^^) 
rather than the reverse expression is the more appropri- 
ate measure of the correlations. 

(ii) Antiferromagnetic case: Next we compare the cor- 
related antiferromagnetic (AFM) ground state |AF) with 
the product states represented by the Slater state |Slat) 
(a spin-density product state in k space) and the Hcisen- 
berg state |Heis) (a perfect Nccl-typc product state in po- 
sition space), respectively. The staggered magnetization 
mst of the Slater state is determined within Hartree-Fock, 
whence dsiat = (("siat)^ ~ ("ist,siat)^)/4. In the Heisen- 
berg state mgt.Hcis = 1 and dnois = 0. As shown in the 
upper panel in Fig.[2]the local entropies S{p) and S{p^^^^) 
are almost identical. A similar agreement is found when 
the local entropies are plotted as functions of the order 
parameter mst instead of the interaction U. Both lo- 
cal entropies decrease from ln4 at J7 = to zero at 
U = oo. This is due to the presence of long-range or- 
der with a magnetization that fully saturates. It means 
that at U — oo the spin degeneracy is completely lifted. 
We observe that S{p) > 5(/5^'^') because m < msiat and 
d < dsiat due to quantum fluctuations, cf. inset of Fig.[T] 
The Slater (weak coupling) and the Heisenberg (strong 
coupling) limits are smoothly connected [30l |. 

The correlated AFM state |AF) can be distinguished 
from the product states |Slat) and |Heis), respectively, 
by the four relative entropies AS'(p||/5^''''), A5(/5||/5"°''), 
AS{p^^^^\\p), and ASip^^'^'llp) which are obtained from 
the three statistical operators p, p^'^', and p^"^^. The 
relative entropies AS{p\\p^^^^) and AS{p^^^*'\\p) are more 
than one order of magnitude smaller than in the PM 
case, as is seen in the inset to the upper panel of Fig. [2] 
As before the relative entropy AS{p\\p^''^^) = oo because 
d-Hcis = 0, implying = for any U. By contrast, 

AS{p^°^^\\p) is finite and approaches zero at large U. 
Correlationwise the Heisenberg product state and the 
correlated AFM state are therefore very similar at large 
U, and cannot be easily distinguished. This means that, 
in contrast to the PM state, the AFM correlated state is 




FIG. 2. Upper panel: local von Neumann entropy S of 
the correlated AFM and the Slater ground states as a func- 
tion of U. Lower panel: local relative entropies AS be- 
tween correlated AFM, Slater, and Heisenberg ground states. 
AS(/3||p^'^') and A5(/3^'^*||p) are magnified by a factor of 50. 



locally only weakly correlated. 

In a further application, we employ the relative entropy 
to quantify correlations in real materials. As an exam- 
ple we select a series of transition-metal (TM) monox- 
ides MnO, FeO, CoO, and NiO. The results are obtained 
within the LDA+DMFT approach [sH - fsst which com- 
bines the local density approximation (LDA) to density 
functional theory with the DMFT We take the 

states obtained from the LDA |LDA) as the uncorre- 
lated states. In Fig. [3] we show the local entropies of 
the series of TM monoxides. The local entropies com- 
puted by LDA4-DMFT describe the corresponding ionic 
ground states, which correspond in all four cases to high- 
spin configurations. The orbital degrees of freedom imply 
that NiO and MnO have a twofold degeneracy, while FeO 
and CoO have a sixfold degeneracy [3j| . The trend in the 
LDA entropy refiects the decreasing number of possibili- 
ties to distribute 5 (MnO), 6 (FeO), 7 (CoO), and 8 (NiO) 
electrons among 10 orbitals, which are modified by the 
crystal-field splitting and deviate from integer occupa- 
tion. The dominant effect of the correlations is to reduce 
the large number of local many-body ground states avail- 
able in the |LDA) solution to only a few in the |DMFT) 
solution. We conclude that MnO, with a c?^ configura- 
tion, is more correlated than NiO which has a (fi con- 
figuration, because in a configuration the interaction 
modifies the local occupation matrix more significantly. 

Finally, we investigate the effect of hole doping on NiO 
[33! . Reducing the 3c? occupation towards half-filling in- 
creases the number of local states with non-negligible 
contribution to the ground state and leads to an increase 
of the local entropy with hole doping in the uncorrelated 
system. In the correlated system the local density ma- 
trix changes substantially. While in stoichiometric NiO 
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FIG. 3. Left panels: Local von Neumann (top) and rela- 
tive (bottom) entropies for MnO, FeO, CoO, and NiO series. 
Right panels; Local von Neumann (top) and relative (bottom) 
entropies for hole doped NiO; see text. 



hole doping leads to a progressive population of dJ and 
(f' (ifgSg''^), respectively. The increase of the number of 
states which effectively contribute to the ground state is 
reflected in the increase of the local entropy. This leads 
to a lowering of the relative entropy with the number of 
holes and to a substantial decrease of correlations. 

In conclusion, we employed the relative von Neumann 
entropy between correlated and factorized (uncorrelated) 
statistical operators to quantify the correlation strength 
in quantum many-body systems. We demonstrated the 
usefulness of this approach by computing the degree of 
correlation in the Hubbard model and in a series of tran- 
sition monoxides using DMFT and LDA-I-DMFT, respec- 
tively. It will be interesting to apply this general concept 
to investigate correlations beyond a single-site approxi- 
mation, in which case not only dynamical local, but also 
spatial correlations are included. 

After publication of the paper we learned that the rela- 
tive entropy was already proposed by A. D. Gottlieb and 
N. J.Mauser [s^ as a means to quantify correlations of 
a many-fermion state by comparing its density operator 
with that of the corresponding free state. 
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A. Probabilistic interpretation of the relative 
entropy 

In quantum theory the von Neumann entropy is given 
by the expectation value of log /5, i.e., S{p) = — (log p)p = 
— Trplogp quantifies the degree to which a quantum sys- 
tem is in a mixed state. In this way one can define a 
relative entropy [T^ ] 



AS{p\\a)^{\ogp)^-{loga)^ 
= Tr(plogp - plogo-). 



(4) 



provided the support [15[ of p is contained in the sup- 
port of a (otherwise A(/5||(5-) is infinite). The relative en- 
tropy m easures "how different" two quantum states are 
[l4l . 17 - [l9| . Let us assume that we experimentally inves- 
tigate a system in an (unknown) state with a statistical 
operator a. We wish to determine whether the system 
is in a particular known state with a statistical operator 
p, or not. While for the measurement on a single sys- 
tem the answer can only be yes or no, an experiment on 
^ 1 many copies of the system allows one to make 
a probabilistic statement about whether the conclusion 



drawn from this measurement is right or wrong. The 
probability for being able to distinguish a system in the 
unknown state with statistical operator a from a system 
in a known state with statistical operator p is given by 
Pip\a) = 1 - exp[-NAS{p\\a)]. If the states are the 
same, in which case a = p, then AS{p\\p) = 0, i.e., 
Pip\p) ~ 0, implying that the two systems cannot be 
distinguished. In the another extreme limit, when the 
support of p is not included in the support of a, the 
probability of discriminating between the state with a 
and the state with p is unity, implying that the two sys- 
tems can be distinguished with certainty. Altogether the 
relative entropy describes how likely it is for two quan- 
tum states to be distinguishable. The relative entropy 
AS{p\\p^^) between a correlated system described by its 
statistical operator p and an uncorrelated product state 
with p^^ is used here to quantify correlations in this sys- 
tem. Thereby it is not only possible to quantify corre- 
lations in a system, but also to compare the degree of 
correlation of different systems. In the paper we pro- 
vide several examples which demonstrate the usefulness 
of this new concept of quantifying correlation in partic- 
ular systems. 

B. Propertes of the relative entropy and corre- 
lation measure 



Prom the properties of the relative entropy it fol- 
lows that: i) for an uncorrelated state with density 
operator p^^ the relative entropy ([3]) is zero, since 
A5((7||(t) = for any density operator a, ii) mix- 
ing a correlated and a product state decreases the 
correlation strength AS{pp + (1 ~ p)p^^\\p^^) ^ 
pA5(p||pPS) + (1 _ p)A5(pPS||pPS) pA5(p||pPS), 

with < p < 1, and iii) increasing the number 
of states increases the correlation strength, i.e., 
A5(®.p.||®.pPS) = E.A5(p,||pP). 

C. Computation of the diagonal elements of 
the statistical operator 

In the atomic representation the local diagonal and 
off-diagonal operators ( "Hubbard operators" ) required to 
compute the matrix elements take the form: 



Pa = 



(l-nt)(l-%) 
(1 - n^)ni 



and 



T 



c\ci 



V C-|-C| —c^ c^ 1 
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Then = (1'|f„,,„J*)t = (vl/|F,^f ,,,,,P„J*)t. 

D. The LDA+DMFT computational scheme 

The Hamiltonians spanning the Hilbert space of 
TM-3d and 0-2p bands in the Wannier representa- 
tion were obtained using the wien2k and wannicrOO 
codes [Al]. The on-site interaction, approximated by 
a density-density form |33j . is diagonal in the occu- 
pation number basis, and was assumed to reside on 
the TM sites. This, together with the fact that the 
non-interacting local propagator is diagonal in the basis 
of cubic harmonics (eg-t2g), leads to great simplification 
of the local occupation matrix. Namely, it is then 
diagonal in the occupation number basis. Its diagonal 
elements are simply obtained by measuring separately 



the contributions of all 2^° states to the local trace 
with a continuous-time quantum Monte-Carlo simula- 
tion [A2]. The corresponding statistical operators are 
diagonal p = J2dPd\Pd){Pd\, where {\pd)} is the d-atomic 
orbital base. Therefore, all local entropies can be easily 
determined. 
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